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Abstract 

Strong subadditivity of von Neumann entropy, proved in 1973 by Lieb and Ruskai, is a corner- 
stone of quantum coding theory. All other known inequalities for entropies of quantum systems 
may be derived from it. Here we prove a new inequality for the von Neumann entropy which we 
prove is independent of strong subadditivity: it is an inequality which is true for any four party 
quantum state, provided that it satisfies three linear relations (constraints) on the entropies of 
certain reduced states. 



^ ; 1 Introduction 

Entropy is a key concept both in classical and in quantum information theory: Shannon's source 
^>0 , and channel coding and half a century of work 9 have exhibited a vast range of operational coding 

problems whose solution can be expressed most naturally by (Shannon-Gibbs-Boltzmann) entropies of 
random variables: 

H{X) = - ^ Pr{X = x} log2 Pr{X = x}. 

pi I 

I ' Quantum information theory [S] allows a wealth of new information processing possibilities, with 

^ . the von Neumann (quantum) entropy playing a role analogous to Shannon's (classical) entropy in 

C^ ' classical information theory: for a density operator p, the von Neumann entropy is 

^: 

Q^. S{p) = -Ti-p\og2p. 



Although the two entropy functionals exhibit similarities, they have many decidedly different prop- 
erties. These properties however, because of the intimate relation of the entropy to operational prop- 
\^ • erties of (classical and quantum) information, ultimately express statements about the "nature of 

5^ , information" . Furthermore, they are indispensable technical tools in proving the information theoretic 

optimality of constructions: most importantly, there are inequalities governing the relative magnitude 
of entropies, conditional entropies and mutual informations. 

In the quantum case, there is essentially only one known inequality (all others being derivable from 
it): strong subadditivity. Proved by Lieb and Ruskai _5_ in 1973, it is the key result on which virtually 
every nontrivial quantum coding theorem relies. 

Wc prove here a new inequality for the von Neumann entropy, which we show cannot be derived 
from the known ones: it is a constrained inequality in that it is not true in general but only for states 
satisfying three particular linear constraints on their entropies. 

One starting point for our work was the desire to understand properties of quantum entropy. We 
were also motivated by investigations of multi-party entanglement in ^: there, entropy values were 
found which are allowed by strong subadditivity but for which the authors could not find quantum 
states. This led to the conjecture that it is impossible to realise those values by a quantum state, 
which we indeed prove here. 

The structure of our paper is as follows: the next section reviews the well-established convexity 
framework for (linear) information inequalities. In section |31 we state and prove our result, while in 
section 0] we explain why it docs not follow from the standard inequalities. In section [3 we present a 
number of alternative forms of our inequality. We close in sectionElwith a discussion and a conjectured 
non-constrained inequality. 



2 Linear inequalities 

Pippenger T initiated the programme of determining all (linear) inequalities satisfied by the classical 
entropy functional H . This question was based on the realisation of two facts (see Yeung's work jlUp: 
first, that in information theoretic applications, the properties one uses about the entropy to bound 
information quantities seem always to be 

1. Nonnegativity of entropy H{X). 

2. Nonnegativity of conditional entropy H{X\Y) = H{XY) - H{Y). 

3. Nonnegativity of mutual information I{X; Y) = H(X) + H{Y) - H{XY) 

4. Nonnegativity of conditional mutual information I{X; Z\Y) = H{XY) + H{YZ) - H{XYZ) - 
H{Y), 

for random variables X, Y, Z, the so-called basic inequalities. 

Second, that for every number n of random variables, the points in K.^ "^ given by the entropies 
of all possible subsets of the random variables, 

{(i?(X5))0^5c{i, ...,„} : Xi,..., Xn random variables} 

(where all random variables are assumed to be discrete and indeed finite range) form "almost" a convex 
cone (i.e., closed under nonnegative linear combinations) in the positive orthant: one only needs to go 
to the topological closure, denoted r„, and called the (classical) entropy cone. 

Surprisingly, the classical entropy cone can be strictly smaller than the cone cut out by the basic 
inequalities for all subsets of random variables (which we will call "Shannon cone" r„): while the two 
cones coincide for n < 3, they differ for n = 4. Indeed, as Yeung and Zhang have shown, there are 
further inequalities satisfied by the entropy cone which are not dependent on the basic inequalities; 
i.e., they are violated by points in the Shannon cone. 

Pippenger j^ observed that a similar situation occurs in the quantum case: with an underlying 
state multipartite state p, denote the entropy of its restriction to subsystems A,..., or groups of 
subsystems AB, . . ., by S{A), S{AB), etc. Then, there is a "von Neumann" cone E„, defined by the 
basic inequalities 

1. Nonnegativity of entropy S{A). 

2. Nonnegativity of the quantity S{A\B) + S{A) = S{AB) - S{B) + S{A) (this is known as the 
Araki-Lieb inequality 0) 

3. Nonnegativity of S'(C| A) + S'(C|B) = S{CA) + SiCB)~S{A)~SiB) (this replaces nonnegativity 
of the conditional entropy, and is called "weak monotonicity" ) . 

4. Nonnegativity of quantum mutual information I{A; B) = S{A) + S{B) — S{AB) 

5. Nonnegativity of quantum conditional mutual information I{A\ C\B) — S{AB) + S{BC) — 
S{ABC) - S{B). 

(Note that the names of the quantities are given based on straightforward analogy, with no operational 
significance implied at this point.) 

The latter two are simply subadditivity and strong subadditivity [5] of the quantum entropy. The 
properties 2) and 3) above, can actually be derived from 4) and 5) (and vice versa) by viewing the 
state as the restriction of a pure state on the given parties plus one, and the fact that for a pure 
state, the entropy of a subset of the parties equals the entropy of the complementary set. This is 
a consequence of linear algebra, namely the Schmidt decomposition of bipartite pure states, whose 
coefficients are the eigenvalues of both reduced states (for a more detailed discussion, see |S]). Note 
also that choosing trivial B (i.e., with Hilbert space C) reduces weak monotonicity to the Araki-Lieb 
inequality, and conditional mutual information to mutual information (compare the classical case). 
Thus all non-trivial inequalities may be derived from strong subadditivity. 



And there is the cone of the closure of aU points reahzed by entropies of the 2" — 1 nontrivial 
marginals, the (quantum) entropy cone I]„, of states on tensor products of n finite quantum systems 
(that it is indeed a cone is proved in the same way as for the classical case IHl). 

The faces of the cone I]„ are given by certain entropies being zero (which means that the corre- 
sponding subsystem is in a pure state), certain mutual informations being zero (which means that 
certain pairs of subsystems are in a product state), certain conditional mutual informations being 
zero, etc. The latter is fully analogous to the classical case of a Markov chain, where A and C are 
independent conditional on B (which we call the "pivot" of the chain) , as explained in 0] . 

All this raises the following natural question: are there any further linear inequalities for the 
quantum entropy than those above? To be precise: is E„ C E„, and if so, can we find a hyperplane 
intersecting the interior or S„ but having E^^ entirely in one halfspace? 

3 The new inequality 

Our main result is the following theorem, which gives an answer to the question in its first form, and 
provides evidence for a positive answer to the second. 

Theorem 1 Let p^^^^ be a state of a quadripartite quantum system, such that strong subadditivity 
is saturated for the three triples ABC, CAB and ADB (pivot always in the middle). Then, 

I{C;D) >I{C;AB). 




The angles in the figure represent the strong subad- 
ditivity constraints which are saturated in the con- 
ditions of theorem (i.e. strong subadditivity is 
saturated for the triples ABC, CAB, ADB; pivot 
always in the middle). Theorem Q then states that 
under these conditions, the correlation between C 
D and D is not smaller than that between C and AB. 

Proof. The proof relies heavily on the recent characterisation of states which saturate strong subaddi- 
tivity 1^, which is stated below as proposition El 

First of all, since we have strong subadditivity saturated for CAB, 

CAB /T\ C'".^ ^ °."s 

P =^P^P^ ®P^ , 

i 

by proposition |2 To this we apply proposition |3 once more, for the triple ABC: there exists the 
recovery map Rb^c' (we duplicate C , and attach a prime, to distinguish the two incarnations of C) 
mapping p^^ to p^^'-' . It maps the above p'^'^^ to 



p^^^^'=0KP,i.pf"^®pf^®p: 



Ca^ ^ afbf ^ bfC' 
1 . 
3 



(Notice that the states on the far right, by the structure of Bb^c" can only depend on j, the Hilbert 
space sector measured by the map, as described in proposition|21below.) 

But the two states obtained by tracing out C and C", respectively (and identifying C with C" 
again), must coincide: 

®y Pi] P. ® P,j ® Pj 



p""'^ = ®,,ft.pr®p" ^®P 



bfC 



Comparing these two, for a given sector labelled ij, with pij > 0, we obtain that both p^ ' and p,' 
are actually product states: 



(1) 



p, ' ^ py (E)p, 



b"C b" c 

Pi =P/ ®Pi- 

That the right hand sides contain both i and j (whereas the left hand sides mention only i and only 
J, respectively) is no error, but in fact the main point: it means that for actually occurring zj, i.e., 
Pij > 0, the state of C belonging to this sector depends only on i and only on j — in other words, it 
must be a common function of z and j: p^, with k — f{i) — g{j), with certain (deterministic) functions 
/ and g. 

We note that if all the pij are strictly positive, then the only way for p^ to be consistent with 
eq. (Q) is for it to be constant, i.e. independent of i and j. Situations in which p^ can vary with i and 
j are only possible when some of the pij are zero. As an illustration, consider a state p^^'~^ which has 
i,j — 1,2,3, and pn > 0, P22 > 0, P23 > 0, P32 > and P33 > 0, but pij = otherwise; then the 
non-constant possibility p^ = pi for i = j = 1 and p^ — p2 ^ p\ for (i, j) = (2, 2), (2, 3), (3, 2), (3, 3) 
(i.e. /(I) = g{\) = 1, /(2) = /(3) = ff(2) = 5(3) = 2) is consistent with eq. (P). 

Returning to the general situation, with fc as described in the previous paragraph but one, we can 
rewrite p'^^'~^ again. 

In fact, let us introduce quantum registers Ka and Kb holding k explicitly (of course, by our obser- 
vation, they will be perfectly correlated) — and note that their content can be extracted locally at A 
and B, respectively, without disturbing the state p'^^^ , by a measurement of the orthogonal subspace 
sector i and j, respectively: 

We shall use the following convention: some of the registers are classical (such as Ka and Kb) inasmuch 
they come with a distinguished basis, and the global state is written as a mixture of states which have 
the classical registers in one of their distinguished basis states. These classical registers we identify 
with random variables, by the same name, for example Ka with distribution 

Pr{KA = k}=pk= Y. P- 

■l:f(i) = k 

This will allow us to speak about the state in quantum theoretical language, and interchangeably about 
its classical properties in random variable language. For example, as random variables, Ka = Kb with 
probability 1, by our earlier observation. 

The proof will now be completed by showing two things: first, that /(C; AB) equals the Holevo 
quantity of the ensemble of the p^, which is I{Ka; C); second, that k is also "known at D" by which 
we mean that there is a measurement on D extracting a random variable Ko perfectly correlated with 
Ka = Kb. 

First, the first claim: the system AB, by our above characterisation, falls into orthogonal sectors 
{AB)k, labelled by fc, and the state in this sector is some aj. ®P^ , because it is a convex combination 

of states p"* ® Pj ' ' ® Pj ® p^, with ij consistent with fc, so they all have the same state p^ on C. 
Hence, there is a quantum operation extracting Ka from AB (a coarse-graining of the disturbance-free 
measurement of i and j), as well as a reverse, creating cr^, in AB from Ka- By monotonicity of 

the quantum mutual information, /(C; AB) = I{Ka\ C). 

The second claim is seen as follows: using the third constraint, I{A]B\D) — 0, with the mono- 
tonicity of the quantum conditional mutual information under the local maps extracting Ka (from A) 
and Kb (from S), gives I{Ka'tKb\D) ~ 0. Proposition [21 guarantees the existence of a measurement 
(whose outcome we think of being stored in a classical register Kb) such that conditional on each 



measurement outcome, Ka and Kb are in a product state. It is straightforward to check that then 
I{Ka;Kb\Kd) — 0, and because Ka and Kb are perfectly correlated, they must also be perfectly 
correlated with Kd- Ka = Kb = Kd with probability 1, as random variables. 

These two facts, by monotonicity of the quantum mutual information under quantum operations, 
finally yield /(C; AB) ^ I{Ka; C) = I{Kd;C) < I{C; D). U 

Proposition 2 (Hayden, Jozsa, Petz and Winter [31) ^ state p^^'~^ saturating strong subaddi- 
tivity at pivot B, i.e., satisfying S{AB) + S{BC) — S{ABC) + S{B), must have the following form. 
There exists an orthogonal decomposition of B 's Hilbert space TIb into subspaces TIb ■ , each of which 
has a natural presentation as tensor product of two Hilbert spaces: 



Ti-B = ^J3 ^b^ ® ^6« J 



such that (with states p ' on Ha (S> 7if,t and p -^ on 7i{,R ® Tic) 



ABC ^T^ -46:^ b';c 



This can be operationally rephrased as follows: there is a quantum operation Rb^c from B to BC 
such that p — (id/i ® Rb^c)p , which has the following form: 

1. Perform a projective measurement associated with an orthogonal decomposition of B into sectors 



B,. 

2. Each sector has a tensor product structure Bj = b^b^ ; having measured j in step 1, the map 

discards the state on b^ and replaces it by p-' on the composite system b^C . □ 

Remark 3 One can easily construct states where our inequality is strict, and others where it is tight: 
a state of the form 



^ABCD _ /T\ ^ . „A ^„B ^ ,„CD 

j 
with </J^^ being arbitrary and having the marginal states tj and Q on C and Z?, respectively, will 



j 

r.CD 

Ljciiig, (Xi uiti cijij a,i.L\i iiaviiig, Lilt; iiicn ji,iii( 



generically have I{C;D) > I{C;AB). If however ip'j' — t^ ® C , with mutually orthogonal r , we 
have equality. 

Also, it is easy to see that no proper subset of our three constraints can imply /(C; D) > I{C; AB): 

1. Saturation of strong subadditivity for ABC and CAB: consider 

p^^^^ = i(|000)(000| + |111)(111|)^''^ ® |0)(0|^. 

It satisfies these two constraints (and may more), but has I{C: D) = and I{C; AB) = 1. 

2. Saturation of strong subadditivity for ABC and ADB: consider 

p^^^^ = i(|000)(000| + |111>(111|)^^ (g> |00)(00|^^. 

It satisfies these two constraints (and many more), but has I{C;D) — and I{C;AB) ~ 1. 

Remark 4 It is worth pointing out that not every application of proposition |21 along the lines of 
our proof of theorem ^ yields a nontrivial result, even though it may seem so at first sight: for 
example, consider a tripartite state p^^'~^ which saturates strong subadditivity for ABC. Then, the 
characterisation of such states implies that p^'-^ is separable, which is well-known to imply S{AC) > 
S{C). Since this inequality is false for general states, have we found a new constrained inequality? 
Actually no: it can be checked immediately that in generality, 

2SiA\C) + /(A; C\B) = [SiA\B) + S{A\C)] + [/(A; B\C)] > 0, 

by the basic inequalities (weak monotonicity and strong subadditivity): hence, if I{A; C\B) — 0, then 
necessarily S{A\C) > 0. 



4 Why the constrained inequaUty is new 

In the introduction we have explained already why for three parties there cannot be an information 
inequality independent of the basic ones, as Eg = E3 jSJE]- Indeed, as one can see from these papers 
there cannot even be a constrained inequality, since on each of the 8 extremal rays of E3 there are 
(nonzero) entropy vectors realised by certain states. 

The four party case is studied in |S] with particular interest in the insights to be gained about 
multi-party entanglement. There it is shown that E4 has 76 extremal rays, which fall naturally into 
8 classes by symmetries (permutation of the parties). For 6 of them [B] gives states realising entropy 
vectors on the rays. The two remaining classes are represented by the rays spanned by the following 
vectors (the first row gives the combinations of subsystems in lexicographic order; below are their 
"entropies"): 





A 


B 


C 
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Clearly, if one could find states realising these vectors (or nonzero multiples), this would prove E4 = E4. 
It is readily verified that both these rays satisfy the condition of theorem^ but not the conclusion: 
both vectors given above have /(C; D) = S{C) + S{D) - S{CD) = but /(C; AB) = S{C) + S{AB) - 
S{ABC) = 2 > 0. 

Corollary 5 There are no quantum states of finite systems realising entropy vectors on the rays I and 
II above. In fact, in the face of the cone E4 described by the three constraint equations of theorem^ 
the new inequality I{C] D) > I{C] AB) cuts off a slice, which contains the rays I and II. □ 

In other words, the two entropy vectors satisfy all the basic inequalities, but by theorem ^ there can 
be no non-trivial quantum state with entropy vector in these rays. 

Thus, theorem ^ cannot be derived from the constraints in its statement using only the basic 
inequalities, and so the new inequality is indeed independent of all previously known inequalities. 



5 Alternative forms of the inequahty 

We have presented the new inequality in theorem ^ in a form which reflects our way of proving it. 
Writing out the mutual informations in terms of entropies, one notices that some terms cancel, and 
we arrive at the following reformulation of our result: 

Theorem 1' Let p-^^'^D he a state of a quadripartite quantum system such that 

S{AB) + S{BC) - S{B) - S{ABC) = 0, 

S{CA) + S{AB) - S{A) - S{CAB) = 0, 

S{AD) + S{DB) - S{D) - S{ADB) = 0. 

Then, S{ABC) + S{D) > S{AB) + S{CD), i.e., I{ABC; D) > I{AB; CD). D 

We present this reformulation mainly because it may help understanding and applying the result. 

There is another one, however, which is less trivial: we can apply the purification trick that is used 
to relate strong subadditivity and weak monotonicity (see section EJ. 

In detail, we construct a purification vp-^BCDS ^^ ^j^g given state p-^scD g^^^ ^g^^^ apply theorem ^ 
or 1' to three situations: strong subadditivity saturated for the triples ABC, CAB and AEB; second, 
for AEC, CAE and ADE; third, for ABE, EAB and ADB. If we then systematically eliminate aU 
entropies involving E by substituting the complementary group, we get the following statements: 

Theorem 1" Let p^^'^^ be a state of a quadripartite quantum system. Consider the following three 
properties this state could have: 



I{A;C\B) 


^I{B;C\A) 


^I{A;B\CD) 


= 


(1) 


S{C\A) + S{C\BD) 


^I(A;C\BD) 


^S{A\D) + SiA\BC) 


= 


(2) 


S{B\A) + S{B\CD) 


^S{A\B) + S{A\CD) 


^I{A;B\D) 


= 0. 


(3) 



Then, 



(1) =^ S{C\AB) + S{C\ABD) > 0, 

(2) =:> S{C\D) + S{C\BD) < 0, 

(3) =^ S{D) + S{CD) > S{AB) + S{ABC). 



U 



6 Discussion 

Although we beheve that the discovery of a new constrained information inequahty is interesting in 
itself, our theoremnis not enough to conclude S4 C S4 because it may be that there are states realising 
entropy vectors arbitrarily close to the points I and II in the previous section. Such a possibility could 
be ruled out by finding an unconstrained inequality satisfied by E| but violated by points on the rays 
I and II. Note that indeed for n = 3, in both the quantum and classical version of the question, the 
set of entropic vectors is not closed, so is not identical to the entropy cone Eg, Fg. On the other hand, 
it is still the case that the extremal rays are indeed populated by distributions/states. 

We may remark that in the classical variant of the question, Yeung and Zhang also at first only 
found a constrained inequality |11| . and only somewhat later their unconstrained inequality in jl2|. 
whose proof indeed uses ideas from constrained inequalities. 

We think, however, that our result provides some evidence towards the existence of such an in- 
equality for the quantum entropy cone; in fact, we believe that it way well be possible to prove an 
inequality ruling out the approximability of I and II, based on the following: in ^, it is conjectured 
that there is a robust version of that paper's main theorem — characterising the states that come 
close to saturating strong subadditivity. It seems likely that with such a theorem one could perform 
an approximation version of the proof of theorem ^ and conclude a new "constrained" inequality if 
the three constraint equations of theorem ^^^rs only almost satisfied. In other words, there would 
be a trade-off between the degree by which I{A\C\B), I{C\B\A), I{A;B\D) are nonzero, and the 
negativity of /(C; D) - I{C; AB). 

This rationalises the following conjecture, with which we close the paper: 

Conjecture 6 There exist positive constants ki, K2 and Kg, such that for all quadripartite states, 
KJiA; C\B) + K2/(C; B\A) + n^I{A; B\D) + [/(C; D) - /(C; AB)] > 0. 
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